On the scaling of Polar Codes: 
II. The behavior of un-polarized channels 
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Abstract — We provide upper and lower bounds on the es- 
cape rate of the Bhattacharyya process corresponding to polar 
codes and transmission over the the binary erasure channel. 
More precisely, we bound the exponent of the number of sub- 
channels whose Bhattacharyya constant falls in a fixed interval 
[a, b]. Mathematically this can be stated as bounding the limit 
lim„_Kx> i ln¥(Z n £ [a, 6]), where Z n is the Bhattacharyya 
process. The quantity P(Z n € [a,b]) represents the fraction of 
sub-channels that are still un-polarized at time n. 



I. Introduction and main result 

The construction of polar codes (|T|) is done by exploring 
a phenomenon called channel polarization in which from a 
BMS channel W, N = 2" sub-channels {W$}i<i<2™ are 
constructed with the property that almost a fraction of I(W) of 
them tend to become noise-less (i.e., have capacity close to 1) 
and a fraction of 1 — I(W) of them tend to become completely 
noisy (i.e., have capacity close to 0). Hence, as n grows large, 
nearly all the sub-channels are in one of the following two 
states: highly noisy or highly noiseless. The construction of 
these channels is done recursively, using a transform called 
channel splitting. Channel splitting is a transform which takes 
a BMS channel W as input and outputs two BMS channels 
W + and W~. We denote this transform by W -> (W + , W~). 
To analyze the behavior of the sub-channels, a probabilistic 
approach is introduced in [1] and |2|. In this regard, the 
polarization process of a BMS channel W, denoted by W n , is 
defined by Wo = W and 

; with probability i, 



W, 



n+l 



W n ; with probability i. 



(1) 



As a result at time n the process W n uniformly and randomly 
outputs a sub-channel from a set of 2 n possible sub-channels 
which are precisely the sub-channels {W^n }i<i<2™ Q The 
Bhattacharyya process of channel W is then defined by 
Z„ = Z(W n ), where Z() denotes the Bhattacharyya constant. 
It was shown in |1| that the process Z n is a super-martingale 
that converges to a random variable Z^. The value of Z^ is 
either (representing the fraction of noiseless sub-channels) 
or 1 (representing the fraction of noisy sub-channels) with 
F w (Z oa = 0) = I(W). We call the two values and 1 the 
fixed points of the process Z„ meaning that as n tends to 
infinity, with probability one the process Z n ends up in one 
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of the these two fixed points. The asymptotic behavior of the 
process Z n around the points and 1 has been studied in [21 
and J3J. However at each time n there still exists a positive 
probability, although very small, that the process Z n takes 
a value not so close to the fixed points. The main objective 
of this paper is to study these vanishing probabilities. More 
precisely, let < a < b < 1 be constants. The quantity 
W w (Z n £ [a,b]) represents the probability that the value of 
Z n is away from the two fixed points and 1 or in other 
words has escaped from the fixed points. For a channel W 
we define the upper escape rate A„ and the lower escape rate 



A 



it' 



as 



E 



i 



Ajf= lim limsup-logP M/ (Z„ £ [a, 6]) (2) 

[o,6]->(0,l) „_>oo n 

Xf = lim lim inf - log F w (Z n e[a,b]). (3) 

[a,6]->(0,l) n 



It is easy to see that the above defined quantities are well 
defined. Also, when A^ = A^ = X w , we say that the escape 
rate of the channel W exists and is equal to X w . In words, as 
n goes large, one expects that 



n < 



'(Z n e[a,b})<2 } 



In the context of polar codes, the quantity ¥ w (Z„ £ [a,b]) 
represents the ratio of the sub-channels that have not "polar- 
ized" at time n. In this paper we consider the case when the 
channel W is a binary erasure channel (BEC). In the analysis 
of polar codes, the analysis of binary erasure channels is more 
significant than other BMS channels. This is because firstly the 
Bhattacharyya process Z n = Z(W n ) corresponding to a BEC 
channel with erasure probability z (BEC(z)) is relatively more 
easier to analyze and it can be described in a closed numerical 
form (|fl]) as Zq = z and 



^n+l 



z n z 

IZn 



; with probability 
; with probability 



(4) 



Secondly the quantities corresponding to BEC channels often 
provide bounds for general BMS channels. Let the functions 
p^ b (z) and 6% b (z) be defined as0 



p a n b (z)=F*(Z n £[a,b}), 
e^ h {z) = Uogp a n b (z). 



2 A11 the logarithms in this paper are in base 2. 

3 To keep things simple, instead of P BEC ' Z '(Z„ £ [a, b]) we write I 



[a,b]). 



(5) 
(6) 
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As a result the upper and lower escape rate for the channel 
BEC(z) can be stated as 



Af CW = lim lim sup C^) 



A 



BEC(z) 



lim liminf 6% b {z). 

a— >0,b— >1 n— >oo 



(7) 
(8) 



In the sequel, we slightly modify the definition of the escape 
rates given in (0 and © and consider the following quantities, 

A„(z,a, 6, <5) = limsup sup 0^ b (x) (9) 

n->oo x£[z-S,z+S] 

Xi(z,a,b,6) =liminf sup 6% h {x). (10) 

x£[z-5,z+5] 

where S € (0, 1) is chosen in a way that [z — S, z + S] C (0,1) 
(we call such a pair of (z, 5) a consistent pair). In words, we 
allow a small perturbation, namely 5, in the erasure proba- 
bility of the channel and define the escape rates accordingly. 
Therefore, when the value of 6 tends to 0, the above quantities 
are a good estimate of the ones given in (O and {8). In this 
paper we first show that 

Lemma 1: The value of X u (z, a, b, S) and Xi(z,a,b,S) is 
the same for all choices of a, b and (z, S) such that a < b 2 . 
We denote the two values by A^ EC and Xf EC respectively. 
■ 

Numerical simulations show that the values of upper and 
lower escape rate are both equal to —0.2758 for all the BEC 
channels. In this paper we provide upper and lower bounds on 
the values of A^ EC and Af EC . 



Theorem 2: We have 
- 0.2786 ! 



1 < A? EC < A 



21n2 



iBEC 



< -0.2669. (11) 



The outline of the paper is as follows. In Section Gj] we 
introduce the basic notations, definitions and tools used in this 
paper. Section [Til] contains the proof of the main results of 
this paper followed by section IV that contains further proofs 
regarding the auxiliary lemmas stated in the paper. 

II. Definitions, notations and preliminary lemmas 

In this section we first give a different but entirely equivalent 
description of the process Z n given in (0]i with the help of a 
collection of maps denoted by <p Un for n £ N. From this we 
also derive the relation between the quantity ^\ogP z (Z n G 
[a,b]) and the maps <fr LOn . We then continue by analyzing the 
functions p c ^ h (z) and 0% (z) defined in (0 and (|6]l and derive 
the relations between the functions 9^ b for different values of 
n and z. 

A. analyzing the random maps </> Wll 

Let {-B n } rl eN be a sequence of iid Bernoulli(i) random 
variables. Denote by (T, fl, P) the probability space generated 
by this sequence and let {F n , £l n , P n ) be the probability space 
generated by {B\, ■ ■ ■ ,B n ). We now couple the process Z n 
with the sequence {B n } ne ^. We start by Z = z and 



Z n -\ 

2-^n-l 



Zn-1 



;if B n 
;if B n 



(12) 



Also, consider the two maps Tq,T\ 
as 

2 



[0, 1] — > [0, 1] defined 



Tq(x) = 2x — x , T\(x) = x 



(13) 



The value of Z n is obtained by applying on the value 
of Z n -i, i.e., Z„ = TB n (Z n -i). The same rule applies for 
obtaining the value of Z n -\ form Z„_2 and so on. Thinking 
this through recursively, the value of Z n is obtained from the 
starting point of the process, Z$ = z, via the following maps. 

Definition 3: For each n € N and a realization 
(&!,••• , b n ) = u) n <G 0„ define the map </i Un by 



TL o Ti 



b n -i 



Let $„ be the set of all such n-step maps. Thus each cf) Un 6 
<3> n is with a one-to-one correspondence with a realization 

,b„) of n n . 

As a result, an equivalent description of the process Z n is as 
follows. At time n the value of Z„ is obtained by picking 
uniformly at random one of the functions in <fi Un 6 $„ and 
assigning the value </> w?i (z) to Z n . Consequently we have, 

P 2 (z„e [a,b])= i^We M) d4) 



^ 2 



I(z e <j>Zt([a,b))). 



Therefore, in order to analyze the behavior of the quantity 
ilogP 2 (Z„ G [a,b]) as n grows large, characterizing the 
asymptotic behavior of the random maps tf> Un is necessary. 
Continuing the theme of Definition [3] one can correspond to 
each realization of the infinite sequence {_B„}„ e N, denoted 
by {frnjneN, a sequence of maps <j> Ul (z), <t>u> 2 ( z )i ' ' ' - where 
LUi = (bi,---,bi). We call the sequence {</> Wfc }fceN the 
corresponding sequence of maps for the realization {6fc}/cgN- 
We also use the realization {6fc}fc g N and its corresponding 
{4>ui k }kefi interchangeably. We now focus more on the asymp- 
totic characteristics of the functions cf> ulri . Firstly, since (p^^ (z) 
has the same law as Z n starting at z, we conclude that for 
z <G (0, 1) with probability one, the quantity lim^oo c/) ulk (z) 
takes on a value in the set {0, 1} . In Figure[T]the the functions 
<j) Un are plotted for a random realization. As it is apparent from 
Figure [T] the functions <f> uln seem to converge point-wise to a 
step function. This is justified in the following lemma. 

Lemma 4 (Almost every realization has a threshold point): 
For almost every realizations of uj = {bk}k&i S there 
exists a point z* S [0,1], such that 



lim 4>uj n {z) 



z€[0,zZ) 

1 z G [zZ, 1] 



Moreover, z* has uniform distribution on [0,1]. We call the 
point z* the threshold point of the realization {bk}k^n or 
the threshold point of its corresponding sequence of maps 

■ 

Looking more closely at ( TT4| ). by the above lemma we 
conclude that as n grows large, the maps <p Un that activate 
the identity function E(.) must have their threshold point 
sufficiently close to z. 
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Fig. 1. The functions <j>^ n associated to 
As we see as n grows large, the functions <f> 
function. 



random realization are plotted. 
,„ converge point-wise to a step 



Definition 7: Let z £ (0,1). Let F™ = {<p Uk (z)\k < 
nAu k G $ fc } and F» = < e $ fc }. We 

call the sets F™ and B™ the nth forward and backward sets 
due to z. Further we call the sets F z = U n F* and B z = U n F* 
the forward and backward sets due to z. In general for an 
arbitrary set A £ (0, 1), by the forward set due to A, denoted 
by Fa, we mean Fa = UzeA ^ ne backward set due to A, 
denoted by Ba, is defined similarly. From Lemma [6] we can 
easily conclude the following. 

Corollary 8: Let z e (0, 1) and to, n £ N. 

1) For x S F™ we have 



n+rai^z) 



?7Z 

- > 8n(x) 

n 



2) For 



y £ B" 1 we have 



, . TO 
1n+m{y) H > 

n 



5. Properties of the functions 8 n and p n 

In this part we focus on the asymptotic value of functions 
f?° ,b (z) and p% (z) given by ((5]) and ©. The following lemma 
states that the choice of a and b is not important. 

Lemma 5 (Equality of the limsups and liminfs): For two 
intervals [a, b], [c,d] £ (0,1), such that a < b 2 and c < d 2 
and for a consistent pair (z,S) we have 



and 



\ u (z,a,b,S) = \ u {z,c, d, 5), 



Xi(z,a,b,S) = Xi(z,c, d, S). 



Therefore, without loss of generality we can fix the value of 
a to j and the value of b to | and prove all the statements 
that appear in the sequel assuming this specific choice of o 
and b. However by Lemma [5] there is no loss of generality in 
the original statement of the main results of the paper. Also, 
in the sequel a and b represent this specific choice mentioned 
above and we will drop the superscripts a, b whenever it is 
clear from the context. 

Lemma 6 (Inequalities between the functions 9 n ): For n £ 
N and z £ (0, 1) we have 

(a) 

e n +i(z) + -^—>6 n (z). 



1 



(b) 



7 n+l 



>max{d n {z 2 ),9 n (2z- z 2 )}. 



Lemma [6] relates the values of the functions 6 n on different 
point of the interval (0, 1) together. The result of Lemma|6]can 
be formalized more generally in the following way. We first 
define the sets F™ and F™ for z £ (0, 1) and n £ N. These 
sets and their asymptotic properties are among the main tools 
in proving the main results. 



III. Proof of the main results 

A. Proof of Lemma Q] 

Consider the sequence {a„} nS N defined as 

a n := sup 6 n (z). (15) 



ri si 

U > 4 J 



We claim that for any consistent pair (z,6), we have 
1 3 

X u (z,-,-,S) = limsupa n 

4 4 n— ^oo 

1 3 

Xi(z, - -,S) = liminf a n . 

4 4 n—yoo 



(16) 
(17) 



Clearly the above statement together with Lemma [5] complete 
the proof of LemmaQ] To prove the claim we use the following 
lemma. 

Lemma 9: Let [c,d] and [e, /] be non-empty intervals in 
(0, 1). There exist a to £ N such that for x £ [c,d] we have 
F™ n [e, /] ^ 0. 

Now fix a pair (z, 5) and let the sequence {it ra } nS N be defined 
as 

u„ = sup 9 n (x). 

xE [z— 6,z-\-6] 

By Lemma [9] there exists a to £ N such that for x £ [z — 
S,z + S] we have F™ n [\, |] ^ 0. As a result, by Corollary [8] 
part (b) for n £ N we have 



m 



(18) 



Similarly as above, there exists a k £ N such that for n £ N 



u n +k>a n , (19) 



and the claim can easily be followed from dT8T > and ( fT9b . 
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B. Proof of Theorem |2] 

1) Lower bound: We first consider the average of the 
functions p n (z) over (0, 1) and use it to provide bounds for 
Af EC . More precisely, let the sequence {6„}„ 6 n be defined by 



Therefore, for z G (0, 1) 



i r 1 

b n :=-log / W-{Z n G [a,b])dz]. 
n Jo 



(20) 



We have 

Lemma 10: Xf EC > lim inf n-^oo b n . 



We now proceed by finding a lower bound on the quantity 
liminfn^oo b n . By (0 we have: 

/ v*(Z n e[a,b])dz= f E^e^'MP 

= E|C n 1 [a,6]|. 
Thus by taking i log() from both sides we have: 

b n = -log[ P Z (Z„ g [a,b])dz = -InE|^- 1 [o,6}j21) 
n J n 

> Ei log l^ 1 [a, 6] | 
n 

The value of limn-^co E^ In [ot, b]\ is computed by the 
following lemma. 

Lemma 11: We have: 

lim _Eitog|0->,&]| = 2^-1. 



ilogP^(Z„e[ a ,6])<ilog§ + ^. 
n 2 4 n 



Hence by tending n to infinity we get 



limsup-logP 2 (Z„ G [a, 6]) < ^log^. 

n^oo n 2 4 



The above idea can be generalized in the following way: let 
a,0 > and define Q n = Z%(1 - Z n f . Going along the 
same lines as above, we get 

J Z«(l + Z n )^ ;if B n = l, 

y "' 1 (2 - Z n )°(l - Z n )^ ; if B n = 0. 

Let A(a, /3) be defined as 

C(a,p) = \ max {z Q (l + zf + (2 - z)«(l - (22) 

2 zG[0,l] 



We have 



And as a result 



E(Q n ) <((<*,?)' 



n— yoo ji 



As a result of the above lemma and ( 1211 we have 



limsup-logP 2 (Z„ G [a, b}) < log ({a, (3). 

ti— >oo 

Minimizing the value of £(a, (3) over all the values of a and 

j3, we get 

limsupilogP 2 (Z„ G [a, b}) < -0.2669. 



Xf > lim inf b n > 



1 



21n2 



- 1. 



IV. Appendix 



2) Upper bound: Let the process Q n be defined as Q n = 



y/Z n (l- Z n ). Following the lead of Lemma 1], we have A Pmo f °f Lemma El 



Qn-\-l Qr 



As a result, 



y /Z n (l + Z n ) ;iffln = l, 

V(2-Z n )(l-Z„) ;iffl n = 0. 



E[Q„+i | Q n ] 

< % max{ v /(2-z)(l-z) + v /z(l + z)} 

2 ze[o,i] 

< Qn^- 

Thus by noting that E(Qo) < 1 we get 

E(Q„) < (^-) • 

Hence by the Markov inequality, it is easy to see that for 
< a < b < 1 there is some a = a (a, b) > such that: 

P z (Z n G[a,b])<a(^-r. 



Recall that for a realization uj = {bk}kefi G SI we define 
Un = (bi, • • • , b n ). The maps To and T\ and hence the maps 
4> Uri s are increasing on [0, 1]. Thus (f> Un (z) — > implies that 
4>u n {z') — > for z' < z and (f> Uri ,{z) — > 1 implies that 
4> Uri (z') — > 1 for z' > z. Moreover, we know that for almost 
every z G (0, 1), linin^oo (f> u „(z) is either or 1 for almost 
every realization {<f>u n }n&$- Hence it suffices to let 

2* = inf{z : <j) Un (z) -> 1}. 

To prove the second part of the lemma, notice that 

z = ¥ z (Z oc = l) 
= P 2 (<^„(z)^l) 
= P 2 (inf{z : <t, Un (z) -> 1} < z) 
= P 2 (4<z). 

Which shows that z* is uniformly distributed on [0, 1]. 
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B. Proof of Lemma \5\ 

Using (fl4] >. we can write p^ l ' +m as follows: 



a.b 



= E ^rE^ e C^>),<fc* (&)])• 

<l>m m <t>* n 

Thus by the union bound we get 

2 m p^ m (z) > F*(Z n G |J (a), CI («)])■ 



where by Q we mean the set of rational numbers. For each 
z G A the set F z is dense in (0, 1). According to part (b), all 
the sets U a ' b are dense and open in (0, 1) . As a result, since 
[0, 1] is a compact space, the set A is also dense in (0, 1) by 
the Baire category theorem. ■ 
Let z G [c, d] . According to Lemma [12] part (a), since B z is 
dense in (0, 1), there exists a (f> Ul G $j, such that (z) G 
(e, /). Now since the function <f>^~} is continuous then there 
exists a neighborhood U z around z such that 4>~^ (U z ) G (e, /) 
and as a result for n> l z and y G U z we have f?^* n [e, /] 7^ 0. 
Also, since [c, ef] C U ze [ c ^]U z and [c, d] is compact, then there 
exist Z\, ■ ■ ■ , z% G [c, d] such that [c, d] C U l i=1 U Zi . The result 
now follows by letting m = maxi<j<jZ Zi . 



now since a < fe 2 , it can easily be verified that 
I^w^ ( a )> ^tJ„ ( a )l contains a closed interval which as m 
grows large, its Lebesgue measure approaches one. As a result 
there exits a k G N such that [c, d] C (J^ [0J fc H a )> 0J,!"( a )] 
and as a result for n G N we have 

2 fe ^ fe (z)>K' d (z)- 
and since 6®> (z) = — Xogp^, we easily get 



. + - (23) 

Similarly, since c < d 2 there exists a £ G N such that for 
n G N we have 



.(*) + 



/ 



> 



na,6 



(z). 



(24) 



Now the proof of the lemma follows by d23l l. (l24l and tending 
n to infinity. 

C. Proof of Lemma [9] 

We first need the following lemma. 

Lemma 12 (Denseness of the forward and backward sets): 
Let (a, b) C (0, 1) be a non-empty interval and z G (0, 1), 
(a) For z G (0, 1) the set is dense in [0, 1]. 
(a) Assuming (a, b) C (0, 1) is a non-empty interval, the set 
?7 a ' b = U„ e N U^ Un e$ n <fi~*(a,b) is a dense and open 
subset of (0, 1). 
(c) The set of points z G (0, 1) for which the set F z is dense 
in (0, 1), is a dense subset of (0, 1). 
Proof: For part (a), let (c, d) be a non-empty interval in 
(0, 1). We must find a function 4> ul[ G $/ such that <t>^~}{z) G 
(c, d) or equivalently z G 0^, (c, d). But as (c, d) is non-empty 
and the set of threshold points is dense in (0, 1), there exists 
a threshold point z* G (c, d). Let {</> u „} be the realization 
which corresponds to z*. Since </> w „(c) — > and <j>u„{d) — > 1, 
there exists some member of this realization, namely Wi , such 
that z G <f) Ul (c,d). This completes the proof of part (a). The 
proof of part (b) follows from part (a) and the fact that the 
set U a ' b is an countable union of open sets. To prove part (c), 
Consider the set 



n 



jja. 



a,6GQn(0,l) 
a<b 



D. Proof of Lemma [6] 
For part (a) we have 



F z (Z n+1 g [a, b]) = -P 2 (Z n G [a,b]) 



Hence, 

2p a n b +1 (z) > tmx{p a /(z 2 ),p%»(2z - z 2 )}, 
and as a result, 

_L I ] gptf 1 (,) + -l T 

> ^-max{i lo gJ # V), - log<- 6 (2z - z 2 )} 

> max{i log^'V), - log^ 6 (2z - z 2 ). 

n n 

The proof of part (a) now follows by noting that 6^' 6 = 
i logp° ,b . For part (b), using O, we can write as 
follows: Let cti = 1 — VI — °> 61 = 1 — \/l — 6, 02 = 
&2 = Vb. We have 

K+i(^) - E ^k^kXiM) 



Y — 



1 I(z G ftj>i,&i]) +I(z G <t>Zl[*2M), 



Hence it is easy to see that: 



1, 



P^l(^)=K' 6 W + §br 2 (^)+Pn' 6l (^)-K' 01 W-Pn' i,2 W], 

or equivalently 

Ptl(z) = \{Pn{zY* M +pT b2 {z))- 

Now by assigning a = \ and b = | we have a 2 < &i. 
Therefore [a,b] C [ai,6i] U [02,62] and 



2K'+ 1 (z)>K' 6 (z), 



(25) 



Hence part (b) can be easily followed in a similar way to part 
(a). 
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E. Proof of Lemma [74] 

In order to compute linin^oo Ei In \ <fizl [ a ,b}\, we define a 
reverse stochastic process {^ n }„ e Nu{o} y i a me inverse maps 
T , Tf~ . Pick a sequence of i.i.d. symmetric Bernoulli 
random variables B\,B2, - ■ ■ and define Z„ = ^ Wr> (z) where 
oj n — (h, ■ ■ ■ , b n ) £ fin and 

=Tr 1 oT 6 : 1 _ o-.-oT, \ (26) 



Lemma 13: The Lebesgue measure (or the uniform prob- 
ability measure) on [0,1], denoted by v, is the unique, and 
hence ergodic, invariant measure for the Markov process Z n . 

Proof: First note that if Z n is distributed according to the 
Lebesgue measure, then 

nzn+i <t) = ]f{z n+1 < T (t)) + ip(z„ < r x (t)) 

= ^ 2 + ^(2*-t 2 )=*. 

This proves the invariance of the Lebesgue measure. In order 
to prove the uniqueness, we will show that for any z € (0, 1), 
Z n converges weakly to a uniformly distributed random point 
in [0, 1], i.e., 

Z«=Vw (*)->"■ (27) 
Knowing that, uniqueness would be proved since for any 
invariant measure p, 



p{.) = VP(Z n £ .) 



\Z n £ .)p{dz) -> (28) 



To prove d27l i, note that f/; Wn has the same (probability) law as 
<j)~ l and we know that <j>^j l {z) — > z* almost surely and hence 
weakly but z* is distributed according to v, which proves the 
statement. ■ 
Theorem 14: We have: 



lim Eiln|0- n 1 [a,6]| = i-ln2. 

n— J-oo Tl Z 



(29) 



F. Proof of Lemma [77J 

Define c = liminf n _ ) . 00 b n and let 7 be an arbitrary positive 
value. Our aim is to show that Af EC > c — 27. Since c = 
liminfn-^oo b n , there exists a 7\ € N such that for n > K we 
have 6„ > c — 7. In other words for n > K we have 

? z (Z n £ [a,6])dz > 2™( C "A 

Hence for any n > max{K, -} there exists a z n € 
( 2 n(c-2 7 ) 5 i _ 2"( c - 2 t)) such that 6>(z„) > c - 7. For 
n > 2max{AT, i} define e„ = [_i — l°g2(~ n ( c ~ 7))J an ^ 
consider the function Cn (z) and the particular point z £n . 
Consider the set B™~ e ™. By Lemma [8] for any y £ B™~ en 
we have: 

-. (30) 



Qn(y) > en (z e J 



On the other hand, consider the functions T Q 1 (z) = Z2 and 
Tf x (z) = 1 - s/T^z. We have 



n—e n times 

A > 1 

T~ l o • • • r " 1 (2"( c - 7) ) = (2 n ( c -T , ))5*=^ 
> 2"( c -7)X -„ ( '- 7 ) 
1 

~~ 2' 

Similarly it is easy to see that if we apply n — e„ times the 
function T^ 1 on 1 — 2 n ^ c ~ 1 \ the resulting value is less than 
|. As a result, it is easy to see that 5"~ e ™ n [|, |] ^ 0. We 
further have: liirin^oo "~ e " — > or there exists a AT' £ N 
such that for n > K' we have "7 e " < 7 ■ Therefore, by 



there exits a j/„ £ B™ c e ™ n 

0n(j/n) 



< 7 
1 31 such that: 

7-7. 



14' 4 

> C - 



Proof: We have: 

|VU a >&]| = V'n(a) - = ip' n (c)(b- a), 

for some c G (a, 6). And by chain rule, 

^n(c) = (T b - n 1 oT bn 1 _ i o...oT b - 1 )'(c) 

= T^'^.T^'iT^ic)). ■ ■ ■ -T^'iT^ o ■ ■ ■ o T-») 

= ^'(^(C)).^ 1 '^^)). ■ • ■ -T^'^n-lCc))). 

Or after taking logarithm, 

1 ™ 

-ln(^„(c)) = -^lnT 6 - 1 (^-i(c)). 

" n j=i 

But according to the ergodic theorem, the last expres- 
sion should (almost surely) converge to the expectation of 
lnT^ 1 (z), where z is assumed to be distributed according 
to v. This can be easily computed as 

W[\nT B 1 i '{z)] = \ [ \o{y/x)'dx + \ f ln(l - s/T^ x)'dx 

= - - In 2. 
2 

This completes the proof. ■ 



Hence for n > max-fiT', If} we have 

sup 6»„(z) > 0„(y„) > c - 27. 
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